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outlined many of the problems, hut also the advantages, of these types of files (Hanft el al., 1990).
7.   Discussions about data for planning, evaluation, and research are typically framed in terms of reliability and validity.    Reliability is the extent to which data are accurate and reproducible.  For instance, high reliability requires that the same data collected at two different times, by two different observers, or by two different measures be essentially the same; it also requires that the rate of missing (or deliberately false) data be low.  Validity is the extent to which data actually measure what they purport to measure.   For instance, a measure of physical mobility should not be confounded by elements of psychological well-being (or vice versa), and a measure of hospital charges may well not correctly indicate hospital costs. Technically, the level of reliability of a data collection instrument or method sets the level of achievable validity, and a measure can never be valid if it is not reliable.
Reliability and validity as defined here are critical, especially for data being gathered in many locations, by many types of providers, for several different uses. The concepts are particularly significant in evaluating outcomes; for example, death may be a reliable indicator of the outcome of care in that it is usually correctly recorded, but it may not be u particularly valid indicator of the quality of the care rendered.
8.  The literature on functional outcomes, health status, and health-related quality of life is quite large—certainly too comprehensive to review here.  For seminal articles and publications in this area over the past 30 years, the reader is referred to Kat?. et al. (1963); Patrick et al. (1973); Kaplan and Bush (1982); Wenger et al. (1984); Bergner (1985); Feinstein (1987); Katz (1987); Lohr and Ware (1987); McDowell and Newell (1987); Stein et al. (1987); Lohr (19S9, 1992); Patrick and Bergner (1990); Spilker ct al. (1990); Greenfield and Nelson (1992); and Stewart and Ware (1992).   Of significance to EMS-C is the fact that the field of health status assessment for children is underdeveloped compared with the situation for adults.
9.  One IOM report, Disability in America, makes a firm distinction between disability and impairments (even permanent ones) and functional limitations.  Disability arises only when the demands of the environment exceed a person's capabilities to meet them or to maintain capacity for age-appropriate tasks (or activities of daily living) (IOM, 1991b).   ADLs include tasks such as eating, dressing, and getting in and out of bed.   lADLs (instrumental ADLs) include more complex activities such as shopping, use of transportation, and use of telephones. Applying these concepts, especially the latter, to children requires identifying the right age-specific activities.
10.  This "expected versus observed" approach to assessing performance is essentially the tactic used by the Health Care Financing Administration in calculating and publishing hospital-specific mortality rates for the Medicare program.  Attractive conceptually, the analyses are extremely hard to do because of the need to control or adjust for many case-mix (patient, diagnosis, and other) variables. Such an approach might be somewhat simpler when applied in the EMS context only, for instance in analyses of trauma deaths in a hospital selling using the so-called TRISS methodology (Champion et al., 1981; Boyd et al., 1987) (see Appendix 7A). However, the enduring controversies about acuity and severity adjusters, coupled with the range of settings in which emergency care can be rendered, makes any broad application of Ihis approach debatable.
11.  Privacy and confidentiality concerns have become increasingly visible in the past decade or so.   Some issues are particularly significant in caring for children.   Families may be anxious to restrict access to information about children's conditions such as HIV infection. Adolescents may wish to receive care without the knowledge of their families (e.g., for pregnancy or abortion).   Cases of suspected child abuse involve not only the medical system but legal and social services as well.
A considerable literature exists about the extent to which sensitive, private information about individuals is (or is not) protected in this country. For seminal publications over the past